Display device viewer gaze attraction

ABSTRACT

Examples relating to attracting the gaze of a viewer of a display are disclosed. One example method comprises controlling the display to display a target object and using gaze tracking data to monitor a viewer gaze location. A guide element is displayed moving along a computed dynamic path that traverses adjacent to a viewer gaze location and leads to the target object. If the viewer&#39;s gaze location is within a predetermined divergence threshold of the guide element, then the display continues displaying the guide element moving along the computed dynamic guide path to the target object. If the viewer&#39;s gaze location diverts from the guide element by at least the predetermined divergence threshold, then the display discontinues displaying the guide element moving along the computed dynamic guide path to the target object.

BACKGROUND

Content creation and/or delivery devices may utilize gaze trackingsystems to track a location of a user's gaze. In some situations, acontent creator such as a movie producer, advertiser, or game developermay desire to direct a user to look at a particular location or featuredisplayed via a display device. Using a gaze tracking system, a currentlocation of a user's gaze may be estimated. If such current locationdoes not correspond to the desired location or feature, the desiredlocation or feature may be visually augmented in a prominent manner tocapture the user's attention and gaze. For example, the desired locationor feature may be highlighted in a bright contrasting color, made tovisually pulsate or blink, and/or otherwise altered in appearance todraw the user's attention.

Augmenting a desired location or feature in this manner, however, may bedistracting to the user and can interrupt an otherwise pleasurable userexperience. Additionally, where the desired feature is an advertisement,the user may not appreciate being intentionally drawn away from the userexperience to view the advertisement.

SUMMARY

Various examples are disclosed herein that relate to attracting the gazeof a viewer. In one disclosed method, a display device is controlled todisplay a target object and gaze tracking data from a gaze trackingsystem is used to monitor a gaze location of the viewer of the display.A guide element is displayed to move along a computed dynamic path thattraverses within a predetermined region adjacent to the gaze location ofthe viewer and leads to the target object.

The gaze tracking data is used to determine if the viewer's gazelocation is within a predetermined divergence threshold of the guideelement. If the viewer's gaze location is within a predetermineddivergence threshold of the guide element, then the display iscontrolled to continue displaying the guide element moving along thecomputed dynamic guide path to the target object. However, if the gazelocation of the viewer diverts from the guide element by at least thepredetermined divergence threshold, then the display is controlled todiscontinue displaying the guide element moving along the computeddynamic guide path to the target object.

This Summary is provided to introduce a selection of concepts in asimplified form that are further described below in the DetailedDescription. This Summary is not intended to identify key features oressential features of the claimed subject matter, nor is it intended tobe used to limit the scope of the claimed subject matter. Furthermore,the claimed subject matter is not limited to implementations that solveany or all disadvantages noted in any part of this disclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic view of example computing devices that may beutilized with displays to attract the gaze of a viewer according toexamples of the present disclosure.

FIG. 2 is a schematic illustration of viewers in a room interacting withcomputing devices and displays that attract the gaze of a vieweraccording to examples of the present disclosure.

FIG. 3 is a schematic illustration of a movie displayed on a displaydevice that may attract the gaze of a viewer according to an example ofthe present disclosure.

FIG. 4 is a schematic illustration of a game displayed on a displaydevice that may attract the gaze of a viewer according to an example ofthe present disclosure.

FIG. 5 is a schematic illustration of a web page displayed on a displaydevice that may attract the gaze of a viewer according to an example ofthe present disclosure

FIG. 6 is a schematic illustration an example head-mounted displaydevice.

FIGS. 7A and 7B are a flow chart of a method for attracting the gaze ofa viewer of a display device according to an example of the presentdisclosure.

FIG. 8 is a simplified schematic illustration of an example of acomputing device.

DETAILED DESCRIPTION

FIG. 1 shows a schematic view of example implementations of a computingdevice for attracting the gaze of a viewer of a display device. Asdescribed in more detail below, the computing device uses gaze trackingdata from a gaze tracking system to monitor the gaze location of theviewer. A gaze attracting program controls the display device to displaya guide element moving along a computed dynamic path that traverseswithin a predetermined region adjacent to the gaze location of theviewer and leads to a target object. If the viewer's gaze stays with theguide element, then the guide element continues moving along thecomputed dynamic guide path to the target object. If the viewer's gazediverts from the guide element by at least a predetermined divergencethreshold, then the guide element is no longer displayed moving alongthe computed dynamic guide path to the target object.

In various examples, the computing device may be either physicallyseparated from or integrated into a display device with which a viewermay interact. FIG. 1 schematically shows an example of a computingdevice 10 that is physically separated from a display device 14. In thisexample, the computing device 10 may comprise or be integrated into aseparate device, such as a set-top box, gaming console, web camera,head-mounted computing device or other wearable computing device,keyboard, dedicated peripheral, or other like device that does notinclude an integrated display.

The computing device 10 may be operatively connected with the displaydevice 14 using a wired connection, or may employ a wireless connectionvia WiFi, Bluetooth, or any other suitable wireless communicationprotocol. For example, the computing device 10 may be communicativelycoupled to a network 16. The network 16 may take the form of a localarea network (LAN), wide area network (WAN), wired network, wirelessnetwork, personal area network, or a combination thereof, and mayinclude the Internet. Additional details regarding the components andcomputing aspects of the computing device 10 are described in moredetail below with reference to FIG. 8.

FIG. 1 also shows an example of a computing device 12 integrated into ahead-mounted display (HMD) device 18. The HMD device 18 may create anddisplay to a first viewer 22 a virtual reality environment or a mixedreality environment. In these examples, the HMD device 18 may include adisplay program 26 that may generate the virtual environment or mixedreality environment for display via the HMD device. The virtualenvironment may include one or more visual elements in the form ofvirtual images, such as three-dimensional (3D) holographic objects andtwo-dimensional (2D) virtual images, that are generated and displayedvia HMD device 18. In a mixed reality environment, the HMD device 18 mayenable the viewer to view such holographic objects and virtual imageswithin the physical environment surrounding the viewer.

As described in more detail below, in some examples the HMD device 18may comprise a transparent, semi-transparent or non-transparent displaythat is supported in front of a viewer's eye or eyes. The HMD device 18may include various sensors and related systems that receive physicalenvironment data from a physical environment. For example, the HMDdevice 18 may include a depth sensor system 30 that includes one or moredepth cameras that generate depth image data.

In some examples the HMD device 18 may include an optical sensor system32 that utilizes at least one outward facing sensor, such as an RGBcamera or other optical sensor. The outward facing sensor may capturetwo-dimensional image information from the physical environment. The HMDdevice 18 may also include a position sensor system 34 comprising one ormore accelerometers, gyroscopes, head tracking systems, and/or othersensors for determining a position or orientation of a user.

The HMD device 18 may also include a transducer system 38 comprising oneor more actuators that convert an electrical signal into another form ofenergy. In some examples, the transducer system 38 may include one ormore speakers for providing audio feedback to a viewer. In otherexamples the transducer system 38 may include one or more tactiletransducers for generating and providing haptic feedback to the viewer,such as vibrations. The HMD device 18 may also include a microphonesystem 42 and one or more microphones for receiving audio input from thephysical environment.

Additionally, the example illustrated in FIG. 1 shows the computingdevice 12 integrated into the HMD device 18. It will be appreciated thatin other examples the computing device 12 may be a separate componentfrom the HMD device 18. Many types and configurations of HMD devices 18having various form factors may be used and are within the scope of thepresent disclosure. A more detailed description of an example HMD deviceis provided below with reference to FIG. 6.

It also will be appreciated that the computing device 12 may comprise orbe integrated into any other suitable type or form of display device,such as a tablet, notebook, smartphone, or other mobile computingdevice, desktop computing device, standalone monitor, wall-mounteddisplay, interactive whiteboard, or other like device having anintegrated display. Such devices may also include a gaze trackingsystem, as described in more detail below.

Both computing device 10 and computing device 12 may include a gazeattracting program 46 that may be stored in mass storage 40. The gazeattracting program 46 may be loaded into memory 48 and executed by aprocessor 52 to perform one or more of the methods and processesdescribed in more detail below.

Computing device 10 and computing device 12 may receive gaze trackingdata 50 from a gaze tracking system 54. In various examples the gazetracking system 54 may be located in display device 14, HMD device 18,or in a common enclosure with any other suitable type or form of displaydevice, including but not limited to those example devices having anintegrated display discussed above. In other examples, the gaze trackingsystem 54 and computing device 10 may be integrated into a commonenclosure that does not include an integrated display, such as ahead-mounted or other wearable device, or in any other suitable type orform of computing device that does not include an integrated display,including but not limited to those example devices without an integrateddisplay discussed above.

With continued reference to FIG. 1, the example display device 14 mayinclude a display system 58 for presenting one or more visual elementsto a second viewer 62. As described in more detail below, the gazeattracting program 46 may utilize gaze tracking data 50 from the gazetracking system 54 to attract the gaze of a viewer via a guide elementdisplayed by display device 14, HMD 18 or other display device.

With reference now to FIGS. 2-5, descriptions of example use cases willnow be provided. FIG. 2 is a schematic illustration of several viewersin a room 200 interacting with computing and display devices that usegaze tracking data from gaze tracking systems to attract the gaze of aviewer. In one example, viewer Alex 202 is watching movie 206 that isdisplayed on a wall-mounted display 210. In this example, wall-mounteddisplay 210 is communicatively coupled to a set-top box 214 thatcomprises a gaze tracking system 54 and a computing device that includesgaze attracting program 46.

With reference now to FIG. 3, in one example the producers of movie 206may desire to attract viewers' attention to a Coffee House 302 that isdisplayed in a scene of the movie. To attract viewers' attention, thegaze attracting program 46 may be configured to control the displaydevice 210 to display a guide element. In this example, the guideelement comprises a bird 306 that may be a computer-generated image thatis added to the movie scene. Using gaze tracking data from the gazetracking system 54, the gaze attracting program 46 may monitor the gazelocation of viewer Alex 202 on the wall-mounted display 210. For exampleand as shown in FIG. 3, using gaze tracking data 50 the gaze trackingsystem 54 may determine that viewer Alex 202 is presently gazing at gazelocation 308.

The bird 306 may be displayed to move along a computed dynamic path 310that leads to the Coffee House 302. Further and to attract the attentionof viewer Alex 202, the computed dynamic path 310 may traverse within apredetermined region 314 adjacent to the gaze location 308 of viewerAlex 202. Additionally and to minimize disruption or distraction of theviewing experience of viewer Alex 202, the dynamic path 310 may becomputed in a manner that causes the movement of the bird 306 to appearnatural and realistic. Advantageously, utilizing such a dynamic path 310may enable viewer Alex 202 to continue watching and enjoying the movie206 without feeling that his attention is being manipulated orintentionally diverted.

In some examples, the computer-generated bird 306 may be displayed tomove along the computed dynamic path 310 according to computer-generatedimage movement rules that govern movement of computer-generated imagesthat are rendered in real time in the movie 206. It will also beappreciated that the present example of a guide element in the form ofbird 306 is provided for illustrative purposes, and that many othertypes, forms and examples of guide elements may be utilized and arewithin the scope of the present disclosure. For example and withreference to the movie 206, other computer-generated guide elements thatmight be utilized include, but are not limited to, a floating leaf, aperson, a car, or any other suitable guide element.

In the example shown in FIG. 3, the predetermined region 314 adjacent tothe gaze location 308 of viewer Alex 202 is a circle having a radius Rthat is concentric with the gaze location. The radius R may bedetermined in any suitable manner and may be based on, for example, oneor more of a distance of viewer Alex 202 from the wall-mounted display210, the size of the wall-mounted display, the size of one or moreelements displayed on the wall-mounted display, the accuracy of the gazetracking system 54, or any other suitable criteria. In various examples,the radius R may have a length of approximately 0.5 mm, 1.0 mm, 5.0 mm,10.0 mm, 50.0 mm, 100.0 mm, or any other suitable distance. It will alsobe appreciated that any other suitable shape and/or configuration of apredetermined region adjacent to a gaze location of a viewer may also beused and is within the scope of the present disclosure.

With continued reference to FIG. 3, as the bird 306 travels along thecomputed dynamic path 310, the gaze attracting program 46 may determineif the gaze of viewer Alex 202 is following the flight of the bird. Inone example, after the bird 306 passes by the gaze location 308, thegaze attracting program 46 may determine whether an updated gazelocation 308′ of viewer Alex 202 is within a predetermined divergencethreshold of the bird 306.

In one example and as shown in FIG. 3, the updated gaze location 308′ ofviewer Alex 202 may be determined to be within a predetermineddivergence threshold of the bird 306 when the updated gaze location isoverlapping at least a portion of the bird 306. In another example, theupdated gaze location 308′ of viewer Alex 202 may be determined to bewithin a predetermined divergence threshold of the bird 306 when thegaze location is within a predetermined distance from the bird, thoughnot necessarily overlapping the bird.

For example and as shown in FIG. 3, a predetermined divergence threshold318 may comprise a circle having a radius T that is concentric with theupdated gaze location 308′. As with radius R discussed above, the radiusT may be determined in any suitable manner and may be based on, forexample, one or more of a distance of viewer Alex 202 from thewall-mounted display 210, the size of the wall-mounted display, the sizeof the bird 306 and/or one or more other elements displayed on thewall-mounted display, the accuracy of the gaze tracking system 54, orany other suitable criteria. In various examples, the radius T may havea length of approximately 0.5 mm, 1.0 mm, 5.0 mm, 10.0 mm, 50.0 mm,100.0 mm, or any other suitable length. It will also be appreciated thatany other suitable shape and/or configuration of a predetermineddivergence threshold may also be used and is within the scope of thepresent disclosure.

Where the updated gaze location 308′ is within a predetermineddivergence threshold the bird 306, the gaze attracting program 46 maycontrol the wall-mounted display 210 to continue displaying the bird 306moving along the computed dynamic path 310 to the Coffee House 302.Advantageously and in this manner, the gaze of viewer Alex 202 may beled to the Coffee House 302, thereby increasing Alex's awareness of theCoffee House. Additionally and as described in more detail below, insome examples the gaze attracting program 46 may also determine that thegaze location of viewer Alex overlaps the Coffee House 302, and inresponse may allocate an ad consumption charge to the Coffee House.

In another example, the gaze attracting program 46 may determine thatthe gaze location of viewer Alex 202 diverts from the bird 306 by atleast the predetermined divergence threshold 318. Alternativelyexpressed and with reference to the example of FIG. 3, the gazeattracting program 46 may determine that the gaze location of viewerAlex 202 is outside of the circle indicated at 318. For example, thegaze attracting program 46 may determine that viewer Alex 202 returnshis gaze to gaze location 308. In this example, the gaze attractingprogram 46 may control the wall-mounted display 210 to discontinuedisplaying the bird 306 moving along the computed dynamic path 310 tothe Coffee House 302.

In another example, the gaze attracting program 46 may monitor and tracka gaze trajectory 312 of viewer Alex's gaze location. In this example, agaze location of viewer Alex 202 may be determined to be within apredetermined divergence threshold of the bird 306 when the gazetrajectory 312 is within a path divergence threshold 316 of the computeddynamic path 310. For example, after the bird 306 passes through thepredetermined region 314 adjacent to Alex's gaze location 308, viewerAlex 202 may initially follow the bird's flight with his gaze such thathis gaze trajectory 312 is within the path divergence threshold 316.

As shown in FIG. 3, in this example the path divergence threshold 316 isa distance between the gaze trajectory 312 and the computed dynamic path310 at a given instance in time. In various examples, the pathdivergence threshold 316 may have a length of approximately 0.5 mm, 1.0mm, 5.0 mm, 10.0 mm, 50.0 mm, 100.0 mm, or any other suitable length. Itwill also be appreciated that any other suitable comparison between thegaze trajectory 312 and the computed dynamic path 310 may be used todetermine if viewer Alex's gaze is following the bird 306, and is withinthe scope of the present disclosure.

As discussed above, if the gaze attracting program 46 determines thatthe gaze trajectory 312 is within the path divergence threshold 316, theprogram may control the wall-mounted display 210 to continue displayingthe bird 306 moving along the computed dynamic path 310 to the CoffeeHouse 302. In another example, the gaze attracting program 46 maydetermine that the gaze trajectory 312 of viewer Alex 202 diverts fromthe computed dynamic path 310 by at least the path divergence threshold316. For example, the gaze attracting program 46 may determine thatviewer Alex 202 shifts his gaze to gaze location 308″ as indicated bygaze trajectory 312. In this example, the gaze attracting program 46 maycontrol the wall-mounted display 210 to discontinue displaying the bird306 moving along the computed dynamic path 310 to the Coffee House 302.

In one example, the gaze attracting program 46 may discontinuedisplaying the bird 306 moving along the computed dynamic path 310 bydiverting the movement of the bird to follow an alternative path 322that does not lead to the Coffee House 302. In this manner, the gazeattracting program 46 may avoid displaying all guide elements travelingto a target object, even when a viewer is not gazing at the guideelement. In other examples, the gaze attracting program 46 maydiscontinue displaying a guide element moving along a computed dynamicpath by no longer displaying the guide element. For example, the gazeattracting program 46 may cause the guide element to disappear from thedisplay.

In another example, the computed dynamic path 310 may beprogrammatically adjusted based upon a change in the gaze location ofviewer Alex 202. For example, where viewer Alex 202 changes his gaze toan updated gaze location 308″ at a bystander 320, the gaze attractingprogram 46 may programmatically adjust the computed dynamic path totraverse within a predetermined region adjacent to the updated gazelocation 308″ and then continue to the Coffee House 302.

In another example and with reference now to FIGS. 1 and 2, viewer Mary230 may play a computer game 234 on her tablet computer 238. The tabletcomputer 238 may include a display 242, a gaze tracking system 54 and agaze attracting program 46. With reference now to FIG. 4, in one examplethe computer game 234 comprises a baseball game 400 that includes aplayer character in the form of batter 404 that may be controlled byviewer Mary 230 and non-player characters in the form of pitcher 408 andoutfielders 412 and 414 that move according to non-player charactermovement rules of the baseball game. The baseball game 400 may alsoinclude at least one object that moves according to object movementrules of the baseball game. In this example, the object may comprise thebaseball 420.

In this example the guide element may comprise the pitcher 408,outfielder 412 and/or baseball 420. For example, the gaze attractingprogram 46 may control the display 242 of the tablet computer 238 todisplay the outfielder 412 moving along a computed dynamic path 430according to the non-player character movement rules. The computeddynamic path 430 leads to the advertisement 434 that is located on theoutfield wall and encourages viewer Mary 230 to “Eat at Café A.” A gazelocation 450 of viewer Mary 230 on the display 242 may be determined andmonitored as described above. The movement of the outfielder 412 alongthe computed dynamic path 430 also may be controlled as described above.

In some examples, Café A may pay a promotional fee to have itsadvertisement 434 displayed in the baseball game 400. In one example, ifthe gaze attracting program 46 determines that the gaze location 450 ofviewer Mary 230 overlaps the advertisement 434, then an ad consumptioncharge is allocated to Café A. Advantageously, in this manner theadvertiser pays a per-impression ad consumption charge that is directlytied to actual viewer impressions of the advertiser's advertisement.

In another example, the promotional fee paid by Café A for theiradvertisement 434 may be at least partially based on a timeframe duringwhich a viewer is gazing at the advertisement. For example, where thegaze location 450 of viewer Mary 230 overlaps the advertisement 434 forless than a predetermined timeframe, a first ad consumption charge maybe allocated to Café A. Where the gaze location 450 of viewer Mary 230overlaps the advertisement 434 for at least the predetermined timeframe,a second ad consumption charge that is greater than the first adconsumption charge may be allocated to Café A. In some examples, thepredetermined timeframe may be 0.5 seconds, 1.0 seconds, 2.0 seconds,5.0 seconds or any other suitable timeframe. Likewise, any suitableamounts may be utilized for the first and second ad consumption charges.

With reference now to FIG. 5, in some examples the target object maycomprise an advertisement that is displayed on a web page. For example,viewer Mary 230 may be viewing web page 500 on her tablet computer 238that includes a touch-sensitive display 242. A guide element in the formof a streaking comet 504 may be displayed to move along a computeddynamic path 506 that traverses within a predetermined region 508adjacent to a gaze location 510 of viewer Mary 230. The computed dynamicpath may lead to a target object in the form of a selectableadvertisement 512 announcing “2 For 1 Pizza” from Café A.

In one example, viewer Mary 230 may provide a viewer input associatedwith the selectable advertisement 512 by touching the screen of display242. The location of her touch selection may be interpreted by thetouch-sensitive screen as being located at a touch location point 514that overlaps a portion of the advertisement 512. Accordingly, thisviewer input selecting advertisement 512 may trigger an ad consumptioncharge that may be allocated to Café A.

However, in some examples viewer Mary 230 may not have intended toselect the advertisement 512. For example, viewer Mary 230 may havelarger-than-average fingers and may have intended to select the “ClickHere” selectable button 520. The touch-detection system of thetouch-sensitive display 242 may have misinterpreted the intendedlocation of her touch as being located at point 514. To address thispossibility, when the touch input of viewer Mary 230 is received and isassociated with advertisement 512, the gaze attracting program 46 maydetermine if the gaze location of viewer Mary 230 overlaps theadvertisement.

In one example, if a gaze location 524 of viewer Mary 230 overlaps theadvertisement 512 when the viewer input is received, then the adconsumption charge is allocated to Café A. On the other hand, if a gazelocation 530 of viewer Mary 230 does not overlap the advertisement 512when the viewer input is received, then the ad consumption charge iscanceled. Advantageously, in this manner inadvertent or unintendedselections of selectable advertisements or other elements on a web pagemay be identified, and corresponding erroneous ad consumption chargesand/or other unintended actions may be avoided.

In another example and with reference again to FIG. 2, viewer Wally 250is wearing an HMD device in the form of a pair of glasses 254. ViewerWally 250 is engaging in a mixed reality experience via the HMD glasses254 that includes a holographic wizard 260 and a guide element in theform of a floating ball 264 that are displayed by the glasses.

In one example the developers of the mixed reality experience may desireto attract viewer Wally's attention to a holographic Coffee Houseadvertisement 270 that is displayed in the room 20. As described above,the gaze attracting program 46 of the HMD glasses 254 may be configureddisplay a guide element. In this example, the guide element comprisesthe floating ball 264. Using gaze tracking data from the gaze trackingsystem 54 of the HMD glasses 254, the gaze attracting program 46 maymonitor the gaze location of viewer Wally 250.

The floating ball 264 may be displayed to move along a computed dynamicpath 274 that leads to the Coffee House advertisement 270. As describedabove, the computed dynamic path 274 may traverse within a predeterminedregion 278 adjacent to a gaze location 282 of viewer Wally 250. As thefloating ball 264 travels along the computed dynamic path 274, the gazeattracting program 46 may determine if the gaze location of viewer Wally250 is within a predetermined divergence threshold of the ball. In oneexample, after the floating ball 264 passes the gaze location 282 thegaze attracting program 46 determines that an updated gaze location 282′of viewer Wally 250 is at the ball and within the predetermineddivergence threshold. Accordingly, the gaze attracting program 46 maycontrol the HMD glasses 254 to continue displaying the floating ball 264moving along the computed dynamic path 274 to the Coffee Houseadvertisement 270.

In other examples and as described above, the gaze attracting program 46may also determine that another gaze location 282″ of viewer Wally 250overlaps the Coffee House advertisement 270, and in response mayallocate an ad consumption charge to the Coffee House.

In another example, the gaze attracting program 46 may determine thatthe gaze location of viewer Wally 250 diverts from the floating ball 264by at least a predetermined divergence threshold. In this example, thegaze attracting program 46 may control the HMD glasses 254 todiscontinue displaying the floating ball 264 moving along the computeddynamic path 274 to the Coffee House advertisement 270. For example, theHMD glasses 254 may divert the floating ball 264 to move along analternative path 286 that does not overlap the advertisement 270. Inother examples, the HMD glasses 254 may cease displaying the floatingball 264.

With reference now to FIG. 6, one example of an HMD device 600 in theform of a pair of wearable glasses with a transparent display isprovided. It will be appreciated that in other examples, the HMD device600 may take other suitable forms in which a transparent,semi-transparent, and/or non-transparent display is supported in frontof a viewer's eye or eyes. It will also be appreciated that the HMDdevice shown in FIGS. 1 and 2 may take the form of the HMD device 600,as described in more detail below, or any other suitable HMD device.

The HMD device 600 includes a display system 602 and a see-through ortransparent display 604 that enables images such as holographic objectsto be delivered to the eyes of a wearer of the HMD device. Thetransparent display 604 may be configured to visually augment anappearance of a real-world, physical environment to a wearer viewing thephysical environment through the transparent display. For example, theappearance of the physical environment may be augmented by graphicalcontent (e.g., one or more pixels each having a respective color andbrightness) that is presented via the transparent display 604 to createan augmented reality environment.

The transparent display 604 may also be configured to enable a wearer ofthe HMD device to view a physical, real-world object in the physicalenvironment through one or more partially transparent pixels that aredisplaying a virtual object representation. As shown in FIG. 6, in oneexample the transparent display 604 may include image-producing elementslocated within lenses 606 (such as, for example, a see-through OrganicLight-Emitting Diode (OLED) display). As another example, thetransparent display 604 may include a light modulator on an edge of thelenses 606. In this example, the lenses 606 may serve as a light guidefor delivering light from the light modulator to the eyes of a wearer.Such a light guide may enable a wearer to perceive a 3D holographicimage located within the physical environment that the wearer isviewing, while also allowing the wearer to view physical objects in thephysical environment, thus creating an augmented reality environment.

The HMD device 600 may also include various sensors and related systems.For example, the HMD device 600 may include a gaze tracking system 608that includes one or more image sensors configured to acquire image datain the form of gaze tracking data from a wearer's eyes. Provided thewearer has consented to the acquisition and use of this information, thegaze tracking system 608 may use this information to track a positionand/or movement of the wearer's eyes.

In one example, the gaze tracking system 608 includes a gaze detectionsubsystem configured to detect a direction of gaze of each eye of awearer. The gaze detection subsystem may be configured to determine gazedirections of each of a wearer's eyes in any suitable manner. Forexample, the gaze detection subsystem may comprise one or more lightsources, such as infrared light sources, configured to cause a glint oflight to reflect from the cornea of each eye of a wearer. One or moreimage sensors may then be configured to capture an image of the wearer'seyes.

Images of the glints and of the pupils as determined from image datagathered from the image sensors may be used to determine an optical axisof each eye. Using this information, the gaze tracking system 608 maythen determine a direction the wearer is gazing. The gaze trackingsystem 608 may additionally or alternatively determine at what physicalor virtual object the wearer is gazing, and at what location on suchphysical or virtual object the wearer is gazing. Such gaze tracking datamay then be provided to the HMD device 600.

It will also be understood that the gaze tracking system 608 may haveany suitable number and arrangement of light sources and image sensors.For example and with reference to FIG. 6, the gaze tracking system 608of the HMD device 600 may utilize at least one inward facing sensor 610.

The HMD device 600 may also include sensor systems that receive physicalenvironment data from the physical environment. For example, the HMDdevice 600 may also include a head tracking system 612 that utilizes oneor more pose sensors, such as pose sensors 614 on HMD device 600, tocapture head pose data and thereby enable position tracking,direction/location and orientation sensing, and/or motion detection ofthe wearer's head.

In one example, head tracking system 612 may comprise an inertialmeasurement unit (IMU) configured as a three-axis or three-degree offreedom position sensor system. This example position sensor system may,for example, include three gyroscopes to indicate or measure a change inorientation of the HMD device 600 within 3D space about three orthogonalaxes (e.g., x, y, and z, or roll, pitch, and yaw). In some examples, theorientation derived from the sensor signals of the IMU may be used todisplay, via the transparent display 604, one or more virtual objectswith a body-locked position in which the position of each virtual objectappears to be fixed relative to the wearer of the see-through displayand the position of each virtual object appears to be moveable relativeto real-world objects in the physical environment.

In another example, head tracking system 612 may comprise an IMUconfigured as a six-axis or six-degree of freedom position sensorsystem. This example position sensor system may, for example, includethree accelerometers and three gyroscopes to indicate or measure achange in location of the HMD device 600 along the three orthogonal axesand a change in device orientation about the three orthogonal axes.

The head tracking system 612 may also support other suitable positioningtechniques, such as GPS or other global navigation systems. Further,while specific examples of position sensor systems have been described,it will be appreciated that any other suitable position sensor systemsmay be used. For example, head pose and/or movement data may bedetermined based on sensor information from any combination of sensorsmounted on the wearer and/or external to the wearer including, but notlimited to, any number of gyroscopes, accelerometers, inertialmeasurement units, GPS devices, barometers, magnetometers, cameras(e.g., visible light cameras, infrared light cameras, time-of-flightdepth cameras, structured light depth cameras, etc.), communicationdevices (e.g., WIFI antennas/interfaces), etc.

In some examples, the HMD device 600 may also include an optical sensorsystem that utilizes one or more outward facing sensors, such as opticalsensor 616 on HMD device 600, to capture image data. The outward facingsensor(s) may detect movements within its field of view, such asgesture-based inputs or other movements performed by a wearer or by aperson or physical object within the field of view. The outward facingsensor(s) may also capture 2D image information and depth informationfrom the physical environment and physical objects within theenvironment. For example, the outward facing sensor(s) may include adepth camera, a visible light camera, an infrared light camera, and/or aposition tracking camera.

The optical sensor system may include a depth tracking system thatgenerates depth tracking data via one or more depth cameras. In oneexample, each depth camera may include left and right cameras of astereoscopic vision system. Time-resolved images from one or more ofthese depth cameras may be registered to each other and/or to imagesfrom another optical sensor such as a visible spectrum camera, and maybe combined to yield depth-resolved video.

In other examples, a structured light depth camera may be configured toproject a structured infrared illumination, and to image theillumination reflected from a scene onto which the illumination isprojected. A depth map of the scene may be constructed based on spacingsbetween adjacent features in the various regions of an imaged scene. Instill other examples, a depth camera may take the form of atime-of-flight depth camera configured to project a pulsed infraredillumination onto a scene and detect the illumination reflected from thescene. For example, illumination may be provided by an infrared lightsource 618. It will be appreciated that any other suitable depth cameramay be used within the scope of the present disclosure.

The outward facing sensor(s) may capture images of the physicalenvironment in which a wearer of the HMD device is situated. Withrespect to the HMD device 600, in one example an augmented realitydisplay program may include a 3D modeling system that uses such capturedimages to generate a virtual environment that models the physicalenvironment surrounding the wearer of the HMD device. In some examples,the optical sensor 616 may cooperate with the IMU to determine thelocation and the orientation of the HMD device 600 in six degrees offreedom. Such location and orientation information may be used todisplay, via the transparent display 604, one or more virtual objectswith a world-locked position in which a position of each virtual objectappears to be fixed relative to real-world objects viewable through thetransparent display, and the position of each virtual object appears tobe moveable relative to a wearer of the see-through display.

The HMD device 600 may also include a microphone system that includesone or more microphones, such as microphone 620, that capture audiodata. In other examples, audio may be presented to the wearer via one ormore speakers, such as speaker 622 on the HMD device 600.

The HMD device 600 may also include a controller, such as controller624. The controller 624 may include a logic subsystem and a storagesubsystem, as discussed in more detail below with respect to FIG. 8,that are in communication with the various sensors and systems of theHMD device 600. In one example, the storage subsystem may includeinstructions that are executable by the logic subsystem to receivesignal inputs from the sensors, determine a pose of the HMD device 600,and adjust display properties for content displayed via the transparentdisplay 604.

FIGS. 7A and 7B illustrate a flow chart of a method 700 for attracting agaze of a viewer of a display device according to an implementation ofthe present disclosure. The following description of method 700 isprovided with reference to the software and hardware componentsdescribed above and shown in FIGS. 1-6. It will be appreciated thatmethod 700 may also be performed in other contexts using other suitablehardware and software components.

With reference to FIG. 7A, at 704 the method 700 may include controllingthe display device to display a target object. At 708 the method 700 mayinclude using gaze tracking data from a gaze tracking system to monitora gaze location of the viewer. At 712 the method 700 may includecontrolling the display device to display a guide element moving along acomputed dynamic path that traverses within a predetermined regionadjacent to the gaze location of the viewer and leads to the targetobject.

At 716 the method 700 may include using the gaze tracking data todetermine if the gaze location of the viewer is within a predetermineddivergence threshold of the guide element. At 720 the method 700 mayinclude, if the gaze location of the viewer is within the predetermineddivergence threshold of the guide element, then controlling the displaydevice to continue displaying the guide element moving along thecomputed dynamic guide path to the target object. At 724 the method 700may include, if the gaze location of the viewer diverts from the guideelement by at least the predetermined divergence threshold, thencontrolling the display device to discontinue displaying the guideelement moving along the computed dynamic guide path to the targetobject.

At 728, discontinuing displaying the guide element moving along thecomputed dynamic guide path to the target object may include divertingthe guide element from the computed dynamic path. At 732, discontinuingdisplaying the guide element moving along the computed dynamic guidepath to the target object may include ceasing to display the guideelement. At 736, the predetermined divergence threshold comprises adistance from the guide element. At 738, the predetermined divergencethreshold comprises a path divergence threshold from the computeddynamic path, and the method 700 may include determining if a gazetrajectory of the viewer diverts from the computed dynamic path by atleast the path divergence threshold. If the gaze trajectory of theviewer diverts from the computed dynamic path by at least the pathdivergence threshold, then the display device may be controlled todiscontinue displaying the guide element moving along the computeddynamic guide path to the target object as discussed above.

With reference now to FIG. 7B, at 740 and where the method 700 isperformed while the viewer plays a computer game, with the computer gamehaving at least one non-player character that moves according tonon-player character movement rules, and at least one object that movesaccording to object movement rules, controlling the display device todisplay the guide element may further comprise moving the guide elementalong the computed dynamic path according to the non-player charactermovement rules or the object movement rules. At 744 and where the methodis performed while the user watches a movie, controlling the displaydevice to display the guide element may further comprise moving theguide element along the computed dynamic path according tocomputer-generated image movement rules for computer-generated imagesthat are rendered in real-time in the movie.

At 748 and where the target object comprises an advertisement from anadvertiser displayed on the display device, the method 700 may furthercomprise, if the gaze location of the viewer overlaps the advertisement,allocating an ad consumption charge to the advertiser. At 752 and wherethe ad consumption charge is a first ad consumption charge, the method700 may further comprise, if the gaze location of the viewer overlapsthe advertisement for at least a predetermined timeframe, allocating asecond ad consumption charge that is greater than the first adconsumption charge.

At 756, where the target object comprises an advertisement from anadvertiser displayed on a web page, the method 700 may include receivinga viewer input associated with the advertisement, with the viewer inputtriggering an ad consumption charge. At 760, if the gaze location of theviewer overlaps the advertisement on the web page when the viewer inputis received, then the method 700 may include allocating the adconsumption charge to the advertiser. At 764, if the gaze location ofthe viewer does not overlap the advertisement on the web page when theviewer input is received, then the method 700 may include canceling thead consumption charge. At 768 the display device may comprise a wearabledisplay device that includes a gaze tracking system.

It will be appreciated that method 700 is provided by way of example andis not meant to be limiting. Therefore, it is to be understood thatmethod 700 may include additional and/or alternative steps than thoseillustrated in FIGS. 7A and 7B. Further, it is to be understood thatmethod 700 may be performed in any suitable order. Further still, it isto be understood that one or more steps may be omitted from method 700without departing from the scope of this disclosure.

FIG. 8 schematically shows a nonlimiting example of a computing system800 that may perform one or more of the above described methods andprocesses. Computing device 10 and computing device 12 may take the formof or include one or more aspects of computing system 800. Computingsystem 800 is shown in simplified form. It is to be understood thatvirtually any computer architecture may be used without departing fromthe scope of this disclosure. In different examples, computing system800 may take the form of a mainframe computer, server computer, desktopcomputer, tablet computer, home entertainment computer, networkcomputing device, tablet, notebook, smartphone, or other mobilecomputing device, mobile communication device, gaming device, etc.

As shown in FIG. 8, computing system 800 includes a logic subsystem 804and a storage subsystem 808. Computing system 800 may optionally includea sensor subsystem 812, display subsystem 816, communication subsystem820, input subsystem 822 and/or other subsystems and components notshown in FIG. 8. Computing system 800 may also include computer readablemedia, with the computer readable media including computer readablestorage media and computer readable communication media. Computingsystem 800 may also optionally include other user input devices such askeyboards, mice, game controllers, and/or touch screens, for example.Further, in some embodiments the methods and processes described hereinmay be implemented as a computer application, computer service, computerAPI, computer library, and/or other computer program product in acomputing system that includes one or more computers.

Logic subsystem 804 may include one or more physical devices configuredto execute one or more instructions. For example, the logic subsystem804 may be configured to execute one or more instructions that are partof one or more applications, services, programs, routines, libraries,objects, components, data structures, or other logical constructs. Suchinstructions may be implemented to perform a task, implement a datatype, transform the state of one or more devices, or otherwise arrive ata desired result.

The logic subsystem 804 may include one or more processors that areconfigured to execute software instructions. Additionally oralternatively, the logic subsystem may include one or more hardware orfirmware logic machines configured to execute hardware or firmwareinstructions. Processors of the logic subsystem may be single core ormulticore, and the programs executed thereon may be configured forparallel or distributed processing. The logic subsystem may optionallyinclude individual components that are distributed throughout two ormore devices, which may be remotely located and/or configured forcoordinated processing. One or more aspects of the logic subsystem maybe virtualized and executed by remotely accessible networked computingdevices configured in a cloud computing configuration.

Storage subsystem 808 may include one or more physical, persistentdevices configured to hold data and/or instructions executable by thelogic subsystem 804 to implement the herein described methods andprocesses. When such methods and processes are implemented, the state ofstorage subsystem 808 may be transformed (e.g., to hold different data).

Storage subsystem 808 may include removable media and/or built-indevices. Storage subsystem 808 may include optical memory devices (e.g.,CD, DVD, HD-DVD, Blu-Ray Disc, etc.), semiconductor memory devices(e.g., RAM, EPROM, EEPROM, etc.) and/or magnetic memory devices (e.g.,hard disk drive, floppy disk drive, tape drive, MRAM, etc.), amongothers. Storage subsystem 808 may include devices with one or more ofthe following characteristics: volatile, nonvolatile, dynamic, static,read/write, read-only, random access, sequential access, locationaddressable, file addressable, and content addressable.

In some examples, aspects of logic subsystem 804 and storage subsystem808 may be integrated into one or more common devices through which thefunctionally described herein may be enacted, at least in part. Suchhardware-logic components may include field-programmable gate arrays(FPGAs), program- and application-specific integrated circuits(PASIC/ASICs), program- and application-specific standard products(PSSP/ASSPs), system-on-a-chip (SOC) systems, and complex programmablelogic devices (CPLDs), for example.

FIG. 8 also shows an aspect of the storage subsystem 808 in the form ofremovable computer readable storage media 824, which may be used tostore data and/or instructions executable to implement the methods andprocesses described herein. Removable computer-readable storage media824 may take the form of CDs, DVDs, HD-DVDs, Blu-Ray Discs, EEPROMs,and/or floppy disks, among others.

It is to be appreciated that storage subsystem 808 includes one or morephysical, persistent devices. In contrast, in some implementationsaspects of the instructions described herein may be propagated in atransitory fashion by a pure signal (e.g., an electromagnetic signal, anoptical signal, etc.) that is not held by a physical device for at leasta finite duration. Furthermore, data and/or other forms of informationpertaining to the present disclosure may be propagated by a pure signalvia computer-readable communication media.

When included, sensor subsystem 812 may include one or more sensorsconfigured to sense different physical phenomenon (e.g., visible light,infrared light, sound, acceleration, orientation, position, etc.) asdescribed above. Sensor subsystem 812 may be configured to providesensor data to logic subsystem 804, for example. Such data may includegaze tracking information, image information, ambient lightinginformation, depth information, audio information, position information,motion information, user location information, and/or any other suitablesensor data that may be used to perform the methods and processesdescribed above.

When included, display subsystem 816 may be used to present a visualrepresentation of data held by storage subsystem 808. As the abovedescribed methods and processes change the data held by the storagesubsystem 808, and thus transform the state of the storage subsystem,the state of the display subsystem 816 may likewise be transformed tovisually represent changes in the underlying data. The display subsystem816 may include one or more display devices utilizing virtually any typeof technology. Such display devices may be combined with logic subsystem804 and/or storage subsystem 808 in a shared enclosure, or such displaydevices may be peripheral display devices.

When included, communication subsystem 820 may be configured tocommunicatively couple computing system 800 with one or more networksand/or one or more other computing devices. Communication subsystem 820may include wired and/or wireless communication devices compatible withone or more different communication protocols. As nonlimiting examples,the communication subsystem 820 may be configured for communication viaa wireless telephone network, a wireless local area network, a wiredlocal area network, a wireless wide area network, a wired wide areanetwork, etc. In some embodiments, the communication subsystem may allowcomputing system 800 to send and/or receive messages to and/or fromother devices via a network such as the Internet.

When included, input subsystem 822 may comprise or interface with one ormore sensors or user-input devices such as a game controller, gestureinput detection device, voice recognizer, inertial measurement unit,keyboard, mouse, or touch screen. In some embodiments, the inputsubsystem 822 may comprise or interface with selected natural user input(NUI) componentry. Such componentry may be integrated or peripheral, andthe transduction and/or processing of input actions may be handled on-or off-board. Example NUI componentry may include a microphone forspeech and/or voice recognition; an infrared, color, stereoscopic,and/or depth camera for machine vision and/or gesture recognition; ahead tracker, eye tracker, accelerometer, and/or gyroscope for motiondetection and/or intent recognition; as well as electric-field sensingcomponentry for assessing brain activity.

The term “program” may be used to describe an aspect of computing device10 and computing device 12 that is implemented to perform one or moreparticular functions. In some cases, such a program may be instantiatedvia logic subsystem 804 executing instructions held by storage subsystem808. It is to be understood that different programs may be instantiatedfrom the same application, service, code block, object, library,routine, API, function, etc. Likewise, the same program may beinstantiated by different applications, services, code blocks, objects,routines, APIs, functions, etc. The term “program” is meant to encompassindividual or groups of executable files, data files, libraries,drivers, scripts, database records, etc.

It is to be understood that the configurations and/or approachesdescribed herein are exemplary in nature, and that these specificembodiments or examples are not to be considered in a limiting sense,because numerous variations are possible. The specific routines ormethods described herein may represent one or more of any number ofprocessing strategies. As such, various acts illustrated may beperformed in the sequence illustrated, in other sequences, in parallel,or in some cases omitted. Likewise, the order of the above-describedprocesses may be changed.

The subject matter of the present disclosure includes all novel andnonobvious combinations and subcombinations of the various processes,systems and configurations, and other features, functions, acts, and/orproperties disclosed herein, as well as any and all equivalents thereof.

1. A method for attracting a gaze of a viewer of a display device, themethod comprising: controlling the display device to display a targetobject; using gaze tracking data from a gaze tracking system to monitora gaze location of the viewer; controlling the display device to displaya guide element moving along a computed dynamic path that traverseswithin a predetermined region adjacent to the gaze location of theviewer and leads to the target object; using the gaze tracking data todetermine if the gaze location of the viewer is within a predetermineddivergence threshold of the guide element; if the gaze location of theviewer is within the predetermined divergence threshold of the guideelement, then controlling the display device to continue displaying theguide element moving along the computed dynamic guide path to the targetobject; and if the gaze location of the viewer diverts from the guideelement by at least the predetermined divergence threshold, thencontrolling the display device to discontinue displaying the guideelement moving along the computed dynamic guide path to the targetobject.
 2. The method of claim 1, wherein controlling the display deviceto discontinue displaying the guide element moving along the computeddynamic guide path further comprises either diverting the guide elementfrom the computed dynamic path or ceasing to display the guide element.3. The method of claim 1, wherein the predetermined divergence thresholdcomprises a distance from the guide element.
 4. The method of claim 1,wherein using the gaze tracking data to determine if the gaze locationof the viewer is within a predetermined divergence threshold of theguide element further comprises determining if a gaze trajectory of theviewer is within a path divergence threshold of the computed dynamicpath.
 5. The method of claim 1, wherein the method is performed whilethe viewer plays a computer game, the computer game has at least onenon-player character that moves according to non-player charactermovement rules, and at least one object that moves according to objectmovement rules, and controlling the display device to display the guideelement further comprises moving the guide element along the computeddynamic path according to the non-player character movement rules or theobject movement rules.
 6. The method of claim 1, wherein the method isperformed while the user watches a movie, and controlling the displaydevice to display the guide element further comprises moving the guideelement along the computed dynamic path according to computer-generatedimage movement rules for computer-generated images that are rendered inreal-time in the movie.
 7. The method of claim 1, wherein the targetobject comprises an advertisement from an advertiser displayed on thedisplay device, the method further comprising: if the gaze location ofthe viewer overlaps the advertisement, then allocating an ad consumptioncharge to the advertiser.
 8. The method of claim 7, wherein the adconsumption charge is a first ad consumption charge, and the methodfurther comprises, if the gaze location of the viewer overlaps theadvertisement for at least a predetermined timeframe, then allocate asecond ad consumption charge that is greater than the first adconsumption charge.
 9. The method of claim 1, wherein the target objectcomprises an advertisement from an advertiser displayed on a web page,the method further comprising: receiving a viewer input associated withthe advertisement, the viewer input triggering an ad consumption charge;if the gaze location of the viewer overlaps the advertisement on the webpage when the viewer input is received, then allocating the adconsumption charge to the advertiser; and if the gaze location of theviewer does not overlap the advertisement on the web page when theviewer input is received, then canceling the ad consumption charge. 10.The method of claim 1, wherein the display device is a wearable displaydevice that includes the gaze tracking system.
 11. A computing devicefor attracting a gaze of a viewer of a display device, the computingdevice comprising: a gaze attraction program executed by a processor ofthe computing device, the gaze attraction program configured to: controlthe display device to display a target object; monitor a gaze locationof the viewer using gaze tracking data from a gaze tracking system;control the display device to display a guide element moving along acomputed dynamic path that traverses within a predetermined regionadjacent to the gaze location of the viewer and leads to the targetobject; using the gaze tracking data, determine if a gaze trajectory ofthe viewer is within a path divergence threshold of the computed dynamicpath; if the gaze location of the viewer is within the path divergencethreshold of the computed dynamic path, then control the display deviceto continue displaying the guide element moving along the computeddynamic guide path to the target object; and if the gaze location of theviewer diverts from the computed dynamic path by at least the pathdivergence threshold, then control the display device to discontinue theguide element moving along the computed dynamic path.
 12. The computingdevice of claim 11, wherein the gaze attraction program is furtherconfigured to move the guide element along the computed dynamic pathaccording to non-player character movement rules that govern movement ofnon-player characters in a computer game which the viewer is playing, oraccording to object movement rules that govern movement of objects inthe computer game.
 13. The computing device of claim 11, wherein thegaze attraction program is further configured to move the guide elementalong the computed dynamic path according to computer-generated imagemovement rules for computer-generated images that are rendered inreal-time in a movie which the viewer is watching.
 14. The computingdevice of claim 11, wherein the target object comprises an advertisementfrom an advertiser displayed on the display device, and the gazeattraction program is further configured to, if the gaze location of theviewer overlaps the advertisement, allocate an ad consumption charge tothe advertiser.
 15. The computing device of claim 14, wherein the adconsumption charge is a first ad consumption charge, and the gazeattraction program is further configured to, if the gaze location of theviewer overlaps the advertisement for at least a predeterminedtimeframe, allocate a second ad consumption charge that is greater thanthe first ad consumption charge.
 16. The computing device of claim 11,wherein the target object comprises an advertisement from an advertiserdisplayed on a web page, and the gaze attraction program is furtherconfigured to: receive a viewer input associated with the advertisementdisplayed on the web page, the viewer input triggering an ad consumptioncharge; if the gaze location of the viewer overlaps the advertisement onthe web page when the viewer input is received, then allocate the adconsumption charge to the advertiser; and if the gaze location of theviewer does not overlap the advertisement on the web page when theviewer input is received, then cancel the ad consumption charge.
 17. Thecomputing device of claim 11, wherein the computing device is integratedinto a wearable display device that includes the gaze tracking system.18. The computing device of claim 11, wherein the computing deviceshares a common enclosure with the gaze tracking system, and thecomputing device does not share a common enclosure with the displaydevice.
 19. The computing device of claim 11, wherein the computingdevice, the gaze tracking system and the display device share a commonenclosure.
 20. In a head-mounted display device worn by a viewer, amethod for attracting a gaze of the viewer, the method comprising:controlling the head-mounted display device to display a target object;using gaze tracking data from a gaze tracking system of the head-mounteddisplay device to monitor a gaze location of the viewer; controlling thehead-mounted display device to display a guide element moving along acomputed dynamic path that traverses within a predetermined regionadjacent to the gaze location of the viewer and leads to the targetobject; using the gaze tracking data to determine if a gaze trajectoryof the viewer is within a path divergence threshold of the computeddynamic path; if the gaze trajectory of the viewer is within the pathdivergence threshold of the computed dynamic path, then controlling thehead-mounted display device to continue displaying the guide elementmoving along the computed dynamic guide path to the target object; andif the gaze trajectory of the viewer diverts from the computed dynamicpath by at least the path divergence threshold, then controlling thehead-mounted display device to discontinue displaying the guide elementmoving along the computed dynamic guide path to the target object.